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ABSTRACT 

The most Important properties of Shift Register Generated sequences are 
exposed. The application of Shift Registers as multiplication and division cir- 
cuits leads to the generation of some error correcting' and detecting codes. 
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^SHIFT REGISTER GENERATORS 
AND APPLICATIONS TO CODING 


INTRODUCTION 

x Randomlike sequences of 0 ! s and l's may be generated from any stage of a 
Shi ft -Register with the proper type of feedback connections; if the feedback con- 
sists only of modulo 2 adders, then the sequence is a linear sequence and the 
Shift -Register Generator is called a linear Shift-Register Generator. These 

devices are useful in communication systems and error detection and correction 
systems. 

The contents of a Shift-Register Generator at time t are a function of the 
number of stages m, the location of the feedback taps, and the contents of the 
SRG at time t - 1. Thus if the m-tuplet in the SRG at time t - 1 is considered 
as the state of the SRG at t - 1 then the state at t is the state ( t - 1) operated 
on by some transition matrix. 

SRG sequences repeat themselves. The repetition period depends on m, the 
number of stages, and feedback taps, but cannot exceed 2 m - 1 bits.* When the 
period is equal to 2 to - 1 bits, then the sequence is called a maximal sequence. 


MAXIMAL AND NON-MAXIMAL SEQUENCES 

When the sequence is maximal, considering the contents of the SRG as an 
m- dimensional vector, then the 2 nt - 1 successive shifts will cause the contents 
of the SRG to assume all possible values of a binary m-tuplet; i.e., if the 2 ra - 1 
(excluding the all 0's vector) vectors of the m -dimensional space are considered 
as points, one can think of the maximal SRG as moving from one point to another, 
thus covering once all 2 m - 1 points in one period. 


In the case of a non-maximal sequence the 2 m - 1 points are divided into 2 
or more sets and the SRG will cover all the points of the set from which a point 
is used as the initial condition of the SRG. Using the above it can be shown that 
the number of zeros in a maxima], sequence is one less than the number of ones; 
thus there are 2 m “ 1 - 1 zeros and 2 m ~ l ones.* 


This will be shown later. 

^ This is the balance property of O’s and l*s of a maximal sequence 



1 


As an example, consider the two 4-stage SHG’s in Figures 1 and 2, where & 
comparison of paths is made between a maximal and a non-maximal SRG’s. The 
maximal sequence has a period 2 m - 1 = 2 4 - 1 = 15 and the non-maximal se- 
quence has pei'iods of 6, 6, and 3, (6 + 6 + 3 = 15) , 

Euler Function and SRG Equivalence 

Consider a maximal m-stage SRG with certain feedback tap connections. 
There exist different feedback tap connections for the same m that produce other 
maximal sequences. The contents of the SRG will again assume all possible 
values of the m-tuplets (except the all zero vector) but the path will be different, 
as shown in Figures 1-3. 

The number of maximal sequences that may be produced by a linear m -stage 
SRG is |- 

$( 2 * ~ 1 ) | ’ 


t 

i • 



. Figure 1. A Maxima) SRG 
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Figure 2. A Non-maxima! 5RG 


where 0(L) is the Euler function^ l > < 2 > and is equal to the number of integers 
less than and relatively prime to L. 

In equation form, V 

\ V ' X : 

fl>(L) = (p L - 1), (1) 

where p k are the divisors of L, and e i is the power to which the corresponding 

divisors must be raised for L = Ilp i with p being prime, 

1 ' \ 

For example, for L = 6, p x - 2, p 2 - 3, e l = 1, e 2 = 1 

0(6) = 2° (2 - 1) 3° (3 - 1) a 2 
for L = 12, Pl = 2, p 2 = 3, e A = 2, e 2 = 1 

0(12) - 2 l (2 - 1) 3° (3 - 1) = 4 


\ 

3 


i 

i 














12 3 



m Sequence 111 10101 10010001111 
Null Sequence 00000000... 


1100 
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10 0 1 


10 11 
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0 0 1 Tj 
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9 rron' 0 . A dTd he , rm0 |] im0 ' r ,UenC9 V 4 ' ,(The bl>x « wi,b ,h ‘ individual vector hove been 
arranged , dentally , a the ones in Figure 1 for comparison of the difference in paths.) 






similarly for p a prime number 


*(P) = P° (P “ 1) = (P 


Using the former method the number of integers less than 6 and prime to 6 
is 2, (i.e., 1 and 5). * 

For L = 12 we have 1, 5, 7, 11; 4 in all. For L = 31 we have 1, 2, S', 4, . . . 
29, 30; 30 in all. For a 4 stage register there are 


4>(2 4 - 1) _ <2>(15) _ 3° 5° (3 - 1) (5 - 1) 

4 4 .4 


2 maximal sequences; 


these are given in Figures 1 and 3. 

Up to this point the type of SRG r s used are the ones where the feedbacks are 
taken from a number of stages and the m th stage, added mod 2, and fed back to 
the first stage. This type of SRG is called a Simple Shift Register Generator 
(SSRG) in contrast to a Modular Shift Register Generator (MSRG) where the 
feedback is taken from the m th stage and fed to a number of stages and the first 
stage through mod 2 adders. 

Each SSRG has an equivalent MSRG in the sense that the sequences produced 
by each stage of any of the two SRG's are identical, except for a time delay. 

An SSRG and its equivalent MSRG’s are shown in Figure 4. 


SSRG 


MSRG 


— 
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III 
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Figure 4. 


In the p-nary case the maximal sequence is of length p m - 1, and it contains 
all possible p-nary m-tuplets. 
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A polynomial of interest is f L (x)*; this polynomial (2) is of degree 4>(L) and 
it contains all primitive L th roots of unity; if L = np,* 1 with p L prime ! 

(x L - 1) - XT' (x L/p i Pi - 1) • XT (x L/ PiPjp^Pi - l) 

f L (x) = 1 /■ (2) 

n-( x L/ Pi - 1) ‘XJ (x L/ P‘PJPk - 1) 

i.i.k 


$ (L)/n> 



i * 1 




then p.(x) are primitive polynomials and any P.(x) will generate a maximal se- 
quence. . 


Equations Determining the Contents of an SR G and the 
Matrix that Characterizes a Given SRG 


If the contents of an m -stage SRG be represented by an m -dimensional row 
vector, then the contents of the shift register one shift later are given by the 
product: 

\ . • • 

C(t + 1) T = A C(t) T (3) 

where A is a transition matrix that characterizes the SRG in question. 


Figure 5 demonstrates A and the associated generalized SRG. To construct 
A one may treat Cft^ as a state vector; the element a. . of A is unity if the 
contents of stage j of the SRG go to state i on the next shift. In the p-nary 
case a. . takes the value of the multiplier connected from stage j to stage i. 

a j + i, j ^ ^ or ^ - 1? 2, ... m (i.e., a 21 = a 32 = a 43 = ... a m m _ 1 = 1). 
This shift register and associated matrix are shown in Figure 5a. 

For the shift register of Figure 5b in addition to the above a 34 - a 63 = a 66 

= a l5 = a 17 = 1 - 


\ 


(x) is referred to as the cyclotomic polynomial. 
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! 



















It was previously stated that Equation (3) gives the contents of the SRG after 
one shift; the contents of the SRG after two or more shifts are given by successive 
applications of Equation (3); thus:* 

X . . 

C(t + 2 ) t = A • C(t + 1) T = A • A • C(t) T = A 2 • C(t) T 
Continuing in the same manner ? 


C(t/+ £) T = , * : C ( t ) T 


W 


A in the above equations may now be considered as a shift operator whose ex- 
ponent Z represents /the number of shifts. • 

The matrix Equation (4) represents m equations, (one for each stage of the 

SRG). 7 ■ 

If the content of stage i at time j is represented by U i (j) then at time j + 1, 
(one shift later), the content of stage i is 


u^j + i) T = a' a (j) 1 


(5) 


where A is now considered as a shift operator and obeys the characteristic 
equation (to be derived later) of the SRG, 

The equation ^ 

U i(j + k) = U._ k (j) 

holds if there are no mod 2 adders between stages i - k and i in the SRG; the 
above equation shys that the content of stage i at t = j + k is identical to 
whatever the content of stage i - k was, k shifts before. 

Equation (5) may be rewritten as 

A l U.(j) = 


T stands for the transpose. 
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■meaning that the contents of stage i - k at time j will be identical to the 
contents of stage i , k shifts after time j . 

In general, instead of speaking of the content of stage i at a specific time j , 
we may refer to the sequence generated by stage i starting at tirfte t, as U(t), 
and substitute (j) by U. (t) in Equation (5) 

A*U.(t) = U.(t + k> = U/. k (t) 

or ' ^ 


A k U.(t) = U^t) 


In words the above equation says that if there are no mod 2 adders between 
stages i - k and i the sequence produced by stage i - k is identical to the 
sequence produced by stage i, k shifts later, or sequence U i lags sequence U i „ k 
by k bits. 

Simple Shift Register Generator (SSRG) and 

Modular Shift Register Generator (MSRG) Equivalence 

A generalized MSRG is of the form of Figure 6a with © standing for 
modulo p addition, dH standing for a unit delay (or a shift register stage) and 
(h.) for multiplication by h j ; the arrow indicates direction and in the case where 
p = 2 h. is 0 or 1. The matrices Ag SRG and A HSR0 for the circuits of Figure 6 


are: 

X 

0 0 0... 7. 0 0 0 h 0 

100 000 h, 


0100000.. .0 0 ~ 

00100.. ...0 0 


0 10 0 0 h 2 


0 0 0 1 0 ...... 0 0 

\jSRG 

001 0 0 h, 

■ / K- 2 

• A 

* "SSRG “ 

/ 

\ 

0000. ...000 1 


0 0 0. ./ . 0 0 0.1 h 

/ / " u 


^hohjhjhj 





Figure 6b. An SSRG 


by inspection A MRQ - A^ ; it will be shown later that these two Shift Registers 
have the same characteristic equation and therefore they are equivalent. 

Characteristic Equation of a Shift Register Generator 

The characteristic equation $> (\) is found by solving^ 3 * the equation 

» “ det I A — \ I m | (6) 

where I B is an identity matrix of order m. 

Since* det | A T - \ l m | = det|A - \ ij the SSRG of Figure 6a and the MSRG 
of Figure 6b have the same characteristic function. 


*See Appendix A. 
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If the operation is mod 2 addition the minus sign can be replaced by plus. 

Example. Finding the Characteristic Equation of a 4 -Feedback Tap SRG 

Consider the 4-feedback tap MSRG of Figure 6. This is a Modular Shift 
Register with all h's except h 0 » hp, h q > h r equal to zero; application of Equa- 
tion (9) results in the characteristic equation 

A m + A r + A* + A p + I = 0 


• Figure 6. 

*See Appendix B. 

'0(A) = 0 i. e . a matrix satisfies its own characteristic equation. 
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/ 


next 


Cycles of a Feedback Shift Register Sequence 

the m ' tuplet Ci - itt -- the shift re " ister: at 


the 


C, T - AC , T 


and at the i th shift 


C T 
S + i 


A l Cf 


We shall prove that there exists a shift £ such that 


which implies that 


'£ + 1 ~ $ Cj - Cj 


= I fof Cj / o 


Suppose that there is no such t so that 


(10) 




( 11 ) 


X = c, 


then t - * and this means that no m-tuplet will repeat itself for an , 

nfini"e q als° e s W a iCh f Impltoa that the num ^ of m -dimensional vectors is 

^finite "field p ST “ ? vector^ 

h p i (excluding the all zero vector; consequently 


l < P* - 1 


the maximum value of £ (designated bv L = - i\ ^k+o- a 

““ - :Msr?.r, y ,rr“i 

StSteSS ^7MSZ?£S! - — - «*. 


X 
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The number of irreducible (but non-primitive) polynomials of degree 4 is 

<P(£ j )/m 


S = p” 1 = 5 1 


$(5) 5° (5 - -1) •; 

^ = -4— = —4 = 1 r .. 

Example: 

Find the number and lengths of sequences for m - 6,p = 2; / 2 ra -l = 63; 
the factors are 63 = 3 2 .7. Try 3; 3 divides 2 2 - 1 and £ l / 3. Try 7; 7 divides 
2 3 -1; therefore £^7. Try 3x7 = 21, it is relatively pure with 2 5 - 1 = 31, 
therefore £j = 21; there are 3 subsequences - (63/21) 


<t><21) 

6 


3° (2) 7° (6) 
6 



Therefore there are 2 irreducible but not primitive polynomials of degree 6, 

When <£(x) is factorable with non-repeating irreducible polynomials as 
factors (this implies that tfi(x) are relatively prime) we may express 4> (x) as 


= C P l (x) 4> 2 (x) 0 3 (x) . . 4> t (x) 


The number of sequences, p A , and corresponding lengths, £ i , for each of the 
polynomials,^, can be expressed as (1, (£^1 and it signifies that ^(x) has 

one sequence of length 1 (the all zero sequence) and /x i subsequences of equal 
length £ . . The reason for the name subsequences is because the space spanned 
by the £ . vectors of one of the p £ sequences is disjoint from the space spanned 
by any other of the p. sequences, such that the sum of all £ , x p . vectors due 
to all p i sequences will span the whole spaces of m, -tuplets (except for the all 
zero vector). 


Thus 


PRECEDING PAGE BLANK 




where m. is the degree of ^(x); the expression [1, /x ; (e t >] is called the cycle 
structure , thus if 11 


0(x) 


<M X ) 0 2 (x) 


and ^(x), 0 2 (x) are irreducible with cycle structures {1, 2 (£ x )] and [l r ix 2 (t 2 )] 

respectively, then the cycle structure of 0(x) is 

[ 1 + Mi(f,)J [l + M 2 (e 2 )] = 1 + M!(£,) + + m(0 (12) 

where* 

4 - 

/X = BCdCfj, l 2 ) 

and .* ■ : ■ ■ - 

’ , ■ W 

i _= J cm(e 1# i 2 ) 


then we have 1 sequence of length 1(0* vector) jx^ sequences of length Z „ ^ 
sequences of length Z 2 and /a sequences of length f, 12 

The sum of the lengths of all sequences is 

• \ . 

e . = . 1 + ^i + M 2 «2 + ^2 gcd(£ 1 ,yi!c I n(£iJ 2 ) 

v, . . 

but 

gcd(e,, t 2 )lcm(l v Z 2 ) = t t l } 

Thus 


*« = 1+ M^i + M 5 « 2 + = (1 +m^i) (1 + /^e 2 ) 

- 2 ® i 2 ™ 2 = 2 m a +m 2 


*gcd — «>- greatest common dividor 
f cm — ^ lowest common multiple 
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i 


which is the length of the sequences of an m, + m 2 - stage shift register. 

The above-sequences can be generated by the circuit of Figure 7 with the 
proxyiar-^nTitial conditions (contents). ■— , 



For example, let + \ 2 + \ + l with f ■ 5 and /T * 3 

and ^ 2 (X) - \ 3 + \ -[* l with f 2 ~ 7 and /x 2 = 1. The cycle structures are 
[1, 3(5)] and [1, 1(7)] , the resultance cycle structure is 

[1,3(5), 1(7), 3*1 (35) 3 = [1,1(7), 3(5), 3(35)] 

thus, besides the all zero sequence there is one sequence in the length 7, three 
with length 5 and three with length 35 so that 


1 + 7 + 3x5+3x 35 = 128 = 2 4+3 


When there are repeated factors the results are too complex to cite.here. 

The Shift and Add Property of Maximal Sequences 

The interpretation of A as a shift operator becomes obvious because every 
time A operates on a sequence the sequence shift by one position, hence the 
exponent of A represents the number of shifts applied to the sequence or the 
number of positions by which the contents of the Shift Register are advanced. 
Since A is an advance operator A** 1 is the delay operator and it will be denoted 
by D where D - A” 1 . 
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Shift and Add Property 


If a maximal sequence is first advanced by an amount t 1 digits and then added 
to itself mod p, the resultant sequence will be the same sequence with a unique 
advance r 2 from the original sequence, which is a function of r x and 4> (x) 

u i (O 4 u i (t + Tj) = V. (t + t 2 ) 
or , 

^ (t) + U. (t) A T i = U 4 (t) A T s 

dividing the last equation by U i (t) ♦ j 

* i 

I + A T i = A r 2 

if r j is known, t 2 can always be found although for most of the cases the pro- 
cedure may prove laborious and long. ! ' 

If a given sequence is advanced more than once and if all the advanced se- 
quences are added to the original one using mod p addition, the resultant sequence 
will be identical to the original one and will have a unique advance from the 
original sequence, i.e., ’ j 

, I . ' ‘ ' 

+ r 2> + U i + T i) + * u i' (t + t) (16) ; 


U. (t) A T where ag is 0,1, ... p - 1 ' (17) 


The above equation may be easily proven if 2 terms of the summation are added 
at a time and replaced by a single term using Equation (14). 


U A (t + i-j) +,U 2 (1 


or 


p m -i 

U.(t)7]a £ A T e = 
£■=0 


(13) 


(14) 


(15) 


R KP !{ 




Qp 


pooh 


the 



If Equation (17) is divided by U. (t) we have: 


p 1 

L 

t* 0 


AT = A T 


( 18 ) 


Equation (18) expresses^. linear combination of all possible p m - 1 powers of A 
in terms of a single power, t , of A if the arithmetic on the exponents t is 
mod p m - 1, (For proofs see Appendix C.) 

Example 1: 

Consider the MSRG A 3 + A + I = 0.in Figure 8a with an equivalent (in this 
case identical) SSRG in Figure 8b. From 8b it can be seen that stage 1 lags 
stage 2 by 2 shifts, that stage 1 lags stage 3 by 1 shift and stage 3 lags stage 2 
by 1 shift. 


5th " 
6th " 
7th 

8th " 
9th ** 
10th " 
11th " 


i 

~T~ 
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3 

u, 0 u 2 
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1 

1 
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2nd ” 
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1 

3 

1 

/ 

3rd " 


. 0 

0 

1 

to h M 

0 

1 

0 

1 


0 

1 

0 

r 

i 

i 

o 


T 




2 

3 

1 


Figure 8b. 


Figure 8a. 
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Now consider the mod 2 addition of stages 1 and 2 from Figure 8b i = 1, 
i-k = i - 2, k = 2; 


U, + u 2 = U, (I + A 2 ) = A-*- 2 Uj (19) 

Taking the characteristic equation A 3 = A + I and squaring it A 6 = A 2 + I 
rewriting (19) 

A* 12 = A 2 + I 

1 1 j = 6 or stage 1 lags the mod 2 sum of 1 and 2 by 6 bits. The delay of 
stage 2 from 1 is -2 or +5. U 2 lags Uj + u 2 by tj + (-2) = 6 - 2 = 4 or 
t 1 +5 = 6+ 5 = 4 mod 7. The delay* of U 3 from Uj is -1 bits or +6. .*■ U 3 lags 
U x + U 2 by tj + (-1) = 5 bits or t ; + 6 = 6 + 6 = 5 mod 7. The above results 
may be verified from the table of Figure 8, 

Example 2: \-\ 


Consider the shift register of Figure 9. 
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so 


U 7 + U s + U 3 = u 2 [I + A 2 * A' 2 ] = A* U, 

2 

' — * > 

Let us solve for t. 

If t refers to U 2 . 

A 5 + A 3 + I = A t+3 

now 

A 3 + I = A t+3 + A s 

A 6 + I = A 7 = A 2 ( t+3 > + A 10 
so 

A 10 + A 7 = A 2 < t+3 > 

* 

A 7 (A 3 + I) = A 2 < t+3 > 

A 3 + I = a 2 ( * + 3 ) *7 
Now let us find A 3 + I = a 4 1 

A 6 + I = A 2tl = A 7 

; _ \ 

SO 

2tj = 7 or 7 mod 127 = 134 
t l = 67 
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u 2 lags u 7 © u 2 © u s by 34 bits. 


Auto -Correlation of a Maximal Sequence 

Recalling the definition of auto -correlation of a sequence v - 


= 


J^ x (t)x( 

t= l 

£>> 


t + t) 


. L 
J_ V — i 

= lZ_. 


x(t)x(t + r) 


(20) 


t**i 


where r is the integral phase difference between the two sequences, and L is ' 
the length of the sequence. 


The terms of the above summation will be l f s if the corresponding digits of 
the two sequences match, and -l’s if they do not match. Consequently the terms 
of the above summation may be considered as another sequence of -l T s and I's 
whose average must be taken.* 

Rewriting the above in equation form 


This definition corresponds to the distance being the Hamming distance for the non*binary case. 
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% X ( T ) = "jJ (number of matching digits or l*s 


( 21 ) 


— number of differing digits or -l’s) 


To solve for R xx (r) one must find the difference between the matching and 
differing digits. One way to do this is to transform the operation of multiplica- 
tion to mod 2 addition. f 

Examination of Figures 10a and 10b, the tables representing multiplication 
and mod 2 addition respectively, shows that multiplication may be replaced by 
mod 2 addition if the l's are replaced by 0 f s and the -l’s are Replaced by l's. 



The difference between matching and differing digits or the difference be- 
tween the number of 0's and l’s under mod 2 addition may now be found easily 
"by making use of the shift and add property of maximal sequences, since the 
above operation is equivalent to taking a maximal sequence of 0 T s and l’s, 
shifting it by r bits, (r ^ 0 mod 2 n - 1), and adding it to the original sequence. 
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original pagb is w 



We know from the shift and add property that the resulting sequence (whose 
elements are the terms of the summation for R xx (r) will be the same maximal 

sequence shifted in. time by some integer delay r 2 , Using the balance property 
of maximal sequences, it is readily seen that there will be 2 n-1 l f s and 2 n ~ l - 1 
0’s in the resultant sequence. Consequently 

1 

R xx ^(t) - (number of 0's — nurrber of l's) 



The Shift Register as a Linear Filter 
Consider the Shift Register of Figure 11. 


. X(t-l) X (t - 2) X {t - 3) X (t - 4) 



Figure 11. • 


If the input sequence X is u(t) = .... 0001000000 • 

then the output sequence Y is Tu (t) = ... 0001100100 

u(t) will be referred to as the impulse function and Tu(t) as the impulse response 
thus 


i 

\ 
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(22) 


T w u(t) = u(t) *- u(t - 1) + u ( t - 4) 

or in general 

T m u(t + i) = U (t + i) + u(t + i - 1) + u (t + i - 4); i = 1,2, 

= u (t + i) + Du(t + i) + D 4 u(t + i) 

i 

~ (I+D + D 4 )u(t+i) 




(23) 


Since this is a linear circuit, if X is a linear combination of k impulse functions 
as given by Equation (24) 


X = 


= aiU ^ 

i “ 1 


(24) 


then Y will be the sum of the responses due to each of these unit step functions. 
Thus in the general case a i ■ 0, 1 # 2 , ... p - 1 


Y = T X = T 


rn 

m / , a i u * i ) = (I + D + D 4 ) a iU (t + i) ( 25 ) 
im * T m 


The transfer function of the filter is defined as 


^ I + D + D 4 - I + A** 1 + A** 4 - A" 4 (A 4 + A 3 + I) (26) 
If the input and output of Figure 11 are interchanged as shown in Figure 12 then 


( 


X = (D + D 4 ) X + Y 
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Figure 12. 


(I “ D - D 4 ) X = Y 


and the transfer function becomes 


_X 

t d y 


I - D - D 4 


in the binary case Equation (27) becomes 


T = 

. D 


I + D + D 4 


By consulting Figure 6b it will be noticed that the characteristic equation of 
the SKG of Figure 11 is 


0(A) = I + A 3 + A 4 = A 44 (A* 4 + A” 1 + I) = A 4 (I + D + D 4 ) 


- A 4 T 


or in general for binary 


T a = A“ n 0(A) 


25 




/ 


Multiplication an d Division with Shift Registers 
Referring to Figure 11 let 

’ / 

• 

X = [ a k* a k— l* a k— 2 ,a k— 3* 8 k— 4 * * * *] " a k + Da k-1 + D2a k~2 + D3a k-3 

where D l is a delay operator representing a delay equal to i; let y. be the re- 
sponse due to a £ with the zero vector as the contents of the SRG at time 0” then 

y* = a k a k 0 0 a k 0 0 0 0 

Dy 2 = a k _! a k-1 o 0 a k _j 0 0 

B 3 y 3 = a k _ 2 a k _ 2 0 - 0 a k-2 0 0 

^ ^4 a k-3 a k— 3 ® ^ a k-3 ® ® .... 

* 

I> 4 y s " a k _4 a k _ 4 0 0 a k _ 4 0 0 

■ ■ . i ■ . 

DSy « ~ X I a k -5 a k— 5 

f 


Since this is a linear network, i.e. f 
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thus 






= a k + DCa^a,,.,) + + + D 3 (a k . 2 + a k . 3 ) 

+ D‘ , (a k + a k . 3 + a k . 4 ) + D s (a k _ , + a k . 4 + a k _ s ) + . , 

+ D " +i (a k - i +a k . i . 3 + a k . i . 4 ) + . . . ^ 

= (I + D+D 4 ) a k + (I+D+D 4 ) Da k .j + (I + D+D 4 ) D J a k _ 2 + 

= (I+JW'D 4 ) (a k + Da k . l + D 2 a k . 2 +. . .) 

thus the Y sequence is equal to the product of the X sequence and the factor 
I+D + D 4 . 

In general /for the circuit of Figure 13 


Y = (h n t®h D + DVa +D Vi + --- + D p " l h 1 +l> , h 0 ) (« k +'D^. 1 +DV a + - • •) 




; \ . ; ; 


= h(D)X(D) 




replacing D by A“ 1 


h(D) = I + A" I h n . 1 + A~ 2 h n _ 2 A _n **h 1 -fc A*"h # .. 

A " [h 0 + Ahj + A s h 2 + . . . + A' , * 1 h n _ 1 + A n ] = A’" ^2 A" - 0(A)] = T 
and 

X(D) = [a-“ A 1 * a k + +•...] 

then 

Y = [A- a k ♦ A k " 1 a k _ J t . . .] j>» - 0(A)] 

Thus after k + n shifts* the sequence Y* = TX - a 0 will be out of the SRG 
output and the contents of the shift register will [ 000 . . f . 00 a 0 J . 

Thus the sequence described by the product of T and X will be out of the 
register after n + k + 1 shifts. 


Notice that the function of the network of Figure 12 becomes obvious by - 
applying the results of circuit theory 

x. 1 . . 

Y = TX 


and this clearly indicates a multiplier. 


By similar procedure^ we could arrive at a division network by reversing 
the inputs and outputs, i.e., the transfer function of Figure 13 is< J1 > 






0(A) 



n 0’s added to the end of the iuput sequence of k + .i as 
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and 


Y 


A" X (D) 
0(A) 


(30) 


In general the a modular LMSC can be characterized by the equation 


P(D) X = Q(D) Y 

for example in Figure 14 



<g) 



For Figure 14a 


W = X + D 2 X + D 3 X + D 4 X + D 3 W + D(W - X) 
or 

(I - D - D 3 ) W = (I - D + D 2 + D 3 + D 4 ) X 
and 

T o = (I - D + D 2 + D 3 + D 4 )/I - D 3 - D 4 
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For Figure 14b 


or 


X = WD 3 + (X - W) D + X(D 2 + D 3 + D 4 ) + W 


X(I - D - D 2 - D 3 - D 4 ) = W(I - D + D 3 ) 


n “ V 


X - D + D 3 

I — D — D 2 - D 3 - D 4 




T _ Y = I 

X I - h „-iD-h n . 2 D2-h n . 3 D 3 -... -h 0 D" 

Appendix F contains more general multiplication and division circuits. 
. Error Correction with SRG's 


(31) 


let a sequence X of 2“ - 1 digits be fed into SKG. The output sequence 
W » TX where T is the transfer function of the filter; if the noise sequence in 
the channel is N the received sequence will be 



' 


if Y is used as the input of the inverse filter, T" 1 , then n J 




= T“* Y = T" 1 (W + N) = X + T" 1 N 


To better understand the generation of a code let us take an example with the 
SKG of Figure 16 and p = 2. . 



Figure 16. * 


The sequence W is 7 bits long (2 3 - 1 = 7). If the number of information bits in 
X is 4 then there are 2 4 - 16 codewords whose first four bits are the informa- 
tion bits and the last 3 are zeros. 

Then / 

x i = ( a i a 2 a 3 a 4 0 0 0) aj = 0 or 1 

X v . y : - 

then X ' 

w i = T x i = (D 3 + D + I) (aj + Da 2 + D 2 a 3 + D 3 a 4 ) 

the x’s and the corresponding w's are shown in Table 1. 

For the construction of Table 1, the impulse function 1000000 = x g was 
first considered and the response w g was found from W = TX; next the delayed 
impulse functions x 4> x 2 and x x were found by delaying w g by the corresponding 
amount; once those basic responses are known then for any i, if x. is expressed 
as a linear combination of x x x 2 x 4 and x g 

i 

x i = b l x I + b J x J + ' b « X 4 + b « x 8 ' 
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Table 1 

The Input and Output of the Encoder 


x 8 =1000000 
x 4 = 0100000 
X 2 = 001000 0 

Xj = 0001000 

x o =2x s = 0 0 0 0 0 0 0 

x 3 =Xj+x 2 = 0011000 
x 3 — Xj x 4 — 0101000 

X- = x 0 + = 0 1 1 0 0 0 0 


w 8 = 1 1 04 0 0 0 


W 0 + 2w g = 0 0 0 0 0 0 0 
w 3 = Wj + w 2 = 0 0 1 0 1 1 1 
W S = w l + w 4 =0111001 
w 6 =w 2 + w 4 =0101110 


x? " + x 2 + x 4 = 0111000 w 7 = Wj + w 2 + w 4 = 0100011 — 


x 9 =1001000 

x 1Q =1010000 
x n = 1 0 1 1 0 0 0 
x 12 * 1 1 0 0 0 0 0 


x 13 = iyo iooo 
x 14 = IX 1 0 0 0 0 

Xj-/ 11110 0 0 


Wg -110 010 1- 

W 10 = 1 1 1 0 0 1 0 - 
w n = 1 1 1 1 1 1 1 

W l2 =1011100 - 

w 13 =1010001 - 
w 14 = 1 0 0 0 1 1 0 - 
W 15 = 1 0 0 1 0 1 1 - 
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The set |w 3 , w 5 , w 6 , w 9 , w 10 , w 12 , w 15 } which contains elements that are 
formed by all possible shifts of the sequence r is sometimes referred to as a 
simplex code. The addition of the additive identity (all zero vector) turns the 
simplex code into a group code R. Our code as generated by the encoder of 
Figure 16 consists of the elements of R and their complements.* ' 

The received sequence Y is used as the input of the SRG of Figure 17 



Figure 17. 

If the noise is zero then = X (the three last digits of ^ are zero).' 

Suppose that one noise digit is a 1 (single error) then the noise vector can . 
be considered as an impulse function and the response of the division SRG of 
Figure 17 to this impulse function is the sequence s t i.e., 1110100, then 

^ = X + 1110100 

\ 

X. 

an altogether different vector from X. Since the number of codewords for this 
example is 16, k =4 and m = 3, the last three bits of any X i are to be zero; 
thus a non-zero vector in the last three bits of X N indicates errors; by delaying 
the impulse discussed above the single error N's and the corresponding 3 last bits 
in X N are shown in Table 2. Then the last three digits of X N could be considered 
syndromes or the phase of the maximal sequence to be added to X w to obtain X. 
Notice that the distance here is 3 or 4 so that all single errors are correctable. 

In general for single error correction in a sequence of length n with m-0 f s 
at the end and k = n - m information bits we must have each of the S f s different 
for each of the n impulses. For this to be possible, each set of m consecutive 
bits in the sequence corresponding to the impulse response must be different. 


The complement of (a v a y a 3 , k . v ) is defined as (p - 1 — a j, p — 1 - a p — 1 -a 3 , • 
p — 1 — with p as the modulus. ; 
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Table 2 


T‘iN 


Error In 
Information 
Bits 



Since we have n non-zero impulses and 2 m - 1 S's then for this to be possible n 
must be equal to a less than 2 ra - 1 for all impulses to be correctable and each 
of die m-bit subsequences of the impulse response of the- decoder should be 
different. If n = 2 m - 1 then this is possible only if the impulse response of the 
decoder is a maximal sequence. To determine the optimality of this code the 
Hamming Bound* equation will be used letting M be the number of codewords 


") 


For single error correction e = 1 and 


M < 2 n / (n + 1) 


For single error correction the Hamming Bound gives the same result as the Varsharmov- 
Gilbert-Sacks condition. 


M 


* r /h 

' i “0 
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When the equality sign holds the code is perfect*; for n = 7 

2 7 , ' - 
M = — = 2 4 = 16 

2 3 


this implies that the maximum number of codewords that the code could have is 
16. Consequently, since our code has 16 codewords, it is optimum. 

Let us now review the necessary conditions for the existence of a single 
error correcting p-nary code generated from shifts of a feedback shift register 
sequence. If each single error is characterized by its amplitude (p - 1 values) 
and position (n positions) the number of distinct correctors must be at least equal 
to n(p- 1), 


Since each signal X is an n-tuplet with the first k symbols used for infor* 
mation and the last m symbols being zeros {check symbols) the number of dis- 
tinct (non-zero) corrector combinations is p m - 1. Thus: 



which is the familiar Hamming bound (or Varsharmov-Gilbert-Sacks condition) 

' for the length of the code. Since n - m + k, the above equation can be rewritten 
as 


P - 1 

and it is an upperbound on the number of information bits (or number of words 
M = p k ). 


*Sce (13) 
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Again in the ease of equality the code is optimum. Thus for an optimum 
code / / 

/ / • 1 

/ n(p - 1) = p m - 1; n = p - i 


This implies/hat we need p ra - 1 distinct m-tuplets in the sequence S, which is 
the impulse/response of the decoder 


S = T' 1 (10000 .... 000) 

S\ 

The only way to have this number of m-tuplets is to insure that S is a maximal 
sequence because only the maximal sequence has a length (period) equal to 
P a - 1* 

Then the code will be n symbols long J 



Since the length of the sequence is p ra - 1 > n one needs only a segment of that 
sequence for each codeword; the only question is which segment. To illustrate 
the above let us consider an example. 

Let p - 3 and m - 2; the maximal length of the sequence isL-p m_ l“8 

Thus to find a polynomial which is primitive and period equal to 8 we must 
first find f g (M because f 8 (M contains all primitive roots* with period 8. 


The order of the polynomial is four (0(8) - 2 2 = 4), and there are 2 




maximal sequences. x 


*Sce Appendix C. 

* Since 8 = 2 3 P t = 2 e i = 5 




The length of the code is 



and k - n - m - 2; thus the number of the codewords is p k — 3 2 = 9. 
By using Equation (2) on page 6 


00 



X 4 + 1 


/\ 


(32) 


this polynomial can be expressed as the product of two irreducible* polynomials 

x 4 + 1 = (x 2 + x + 2) (x 2 + 2x + 2) 

" ^i(x)0 2 (x) (33) 


To find the matrices corresponding to (x) and 0j(x) use the matrix in the 
companion form 
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thus 


<t>i (x) = X 2 + X + 2 



and 



for <£ 2 (x) 



(34) 


A 



for 0 3 (x) 


(35) 


Now we must see if the noivnnrm-QT jl / x . 

integer powers and observing the power lT ‘ whi^T ^ 

* 


iWU) uj 


(root ) L = 1 


(37) 


theorem the matrix A satisffes tte “““ by 016 Cale y-H^ilt< 

carry the above test with the matrix A instead^me “ * a<X> ^ " C0Uld 


•^2 (A) = A 2 + 2A + 21 


implied 


A 2 


A + I 


by substituting all A 2 by A 


+ I we can obtain Table 3 for the powers of A 
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Table 3 



It should be noticed that the same re suits, could have been obtained by matrix 
multiplication, i.e. 



BEPRODUCBILITY OF TH1 . 
ORIGINAL PAGE IS POOF. 
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2 register that obeys <£ 2 (A.)in the form of Equation (10) (<£ 2 (\) = 

- h i \ - h 0 = \ 2 - \ - 1 which is equivalent to k 2 + 2 k + 2) 2 is shown 
in Figure 18; notice that the contents of the shift register at shift i represent 
the coefficients of the polynomial representing A* in Table 4; notice also that 


Table 4 
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7 1 2 

® 0 i 

i 

Figure 18. The PRG with + (^(A.) = - A - I = (A^ + 2 A + 2l) = 0 

end the Contents at Time i \ i = 0, . , » 8 * 

i 

the sequence s = 1120, 2210 is the maximal impulse response and it consists of 
two subsequences „ 

s = S lf 2Sj 

where Sj =1120. 

The code can be generated by using the multiplication circuit which multi- 
plies by the polynomial 0 2 (\) = A 2 + 2 A + 21. This can be accomplished with 
the circuit of Figure 19. _ 
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Figure 19. The Encoder 

SO that 


W = 0 a (A) X(A) = (A 2 + 2A + 21) X(A) 


= A 2+n (I + 2D + 2D 2 ) X(D) 


The decoder results from the division circuit which is constructed using the 
following reasoning. Assuming that there are no errors the received signal 
Y = W multiplied by some function F must result in the transmitted signal X 


but since 



(38) 


W = TX 



(39) 


(40) 


( 41 ) 
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1 


Since F is the output X N divided by the input Y Equation (41) can be rewritten 
as ' 


*n I Y _ Y Y '' 

Y = T or = T = 4^T) = A , t2A+2I 

Application of Equation (8) and Figure 6 with m 58 2 gives’ h 0 
and the decoder becomes the circuit of Figure 20 



Figure 20. 

Since -2=1 mod 3 the decoder of Figure 20 is equivalent to the decoder of 
Figure 21. ~- 



Fi gure 21. The Decoder Corresponding to the Encoder of Figure 11 

The impulse respohse of the decoder is the sequence s of page 45; this se- 
quence could also be obtained by long division as follows. 
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A 2 A I 
1 2 2 




11 20 22 10~-S 

VT~ o o 

-1 -2 -2 K 

\ 

0 110 - — • 

-1 -2 -2 
0 2 10 

-2 -1 -1 " * 
0 0 2 0 0 
-2 -1 -1 
0 2 2 0 
-2 -1 -l 
0 12 0 


-1 -2 -2 
0 0 10 0 


. c JJ'® °° de ' V as generated b y fee circuit of Figure 19 is shown in Table 4 and 
e segments (subsequences) of the reverse sequence r of page 38. 

The response of the decoder circuit of Figure 21 to all single error patterns 
is shown in Table 5. It should be noted that all eight L- l) (")) single error 

patterns are correctable because the corresponding correctors (the ternary 

representation of the last two digits in the response excluding the 0000 vector) • 
are distinct. 1 < 

To reconstruct the information symbols of X no change is required when 
the corrector S is 11, 01, 22, or 02 (and of course 00). 

. , ' Wlen tbe error becomes obvious the beginning of the sequence must be 
added mod 3 to X N to correct it; one way to produce the beginning of the sequence 

ntodl^°h M Tl 1S USe the oonneotion for reverse sequence which is 
produced by the shift register of Figure 22 (see Appendix E). 
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Table 5 


N 

. 

Response - T" 1 N 

Error In 
Information ... 
Symbols 

S 

Number 
, Represented 
by S 

10 0 0 

112 0 

1 1 

KB 

6 

0 10 0 

0 112 

0 1 

mam 

5 

0 0 10 

0 0 11 

• 

0 0 


. *4 

0 0 0 1 

0 0 0 1. 

.0 0 


'• 1 

2 0 0 0 

2 2 10 

2 2 ’ 

; i o' 

3 

0 2 0 0 

0 2 2 1 

0 2 

. 2 1- 

7 

0 0 2 0 

0 0 2 2 

0 0 

2 2 

8 

0 0 0 2 

0 0 0 2 

0 0 

0 2 

2 


\J 


The Hamming bound for this code gives the maximum k. 


k ma. = 

ri ^ - m 
m ax 


for e - 1 

i ■ . 

n - 

max 

p m-l + pO 

-2 

1 .* "• 
i 

+ * * * + 1 


' 



. ' = 

3 + 1 = 

4 

1 ' 

[ . - 




thus since in our case n is also equal to 4 this code is optimum. 



Figure 22. 
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SUMMARY 


Thus far we have used the m— stage Shift Register for single error correction 
by encoding k digits into k + m = n such that 

r 


P m - 

p - 1 


(42) 


w'ith the equality resulting in an optimum code; it should be kept in mind that for 
this class of single error correcting codes the check bits are equal to the num- 
ber of stages of the shift register and n is determined from' Equation (42). If n 
is much smaller than tli4 value indicated by the equality of Equation (42) then 
the code may be able to correct more than single errors. For example if p = 2 
m = 4 then all singly' errors will be correctable if 


n < p D - 1 = IS 


if n = 15 then k = 11 and the size of the code, if a SRG is possible, would be 
2 l „ Suppose that we don't need such a large size for the code but we still want n 
to be the length of the maximal sequence (n = 15) then the code if selected 
properly will be able to correct more than all the single errors if k = 4 then 
M = 16 and we can use as codewords the 15 shifts of the maximal sequence and 
the all zero vector. The Hamming distance for this code is 8 and the code will 
correct all single double and triple errors and detect all quadruple errors. 
These codes will be discussed later if we want k to be five M = 32, and the 
code words will be the fifteen shifts of the maximal sequence, the fifteen shifts 
of the reverse sequence the zero vector and the 1 vector. Since the distance is 
the weight of each code word, and the minimum weight of the reverse codes is 7, 
the code will correct all single, double and triple errors, and it will detect some 
of the quadruple errors (some of the distances have the value 8).* 

Pseudorandom Codes 


In the last section the codes were in general segments of the maximal se- 
quence; however the codeword was all L shifts of the maximal sequence. In 
this section we shall consider codes whose words are the p k - 1 shifts of a 
maximal sequence and the all zero vector. 


This is the code described in ( 17 ). 
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For this code n = p k - 1, the number of information digits are k , and i 
they could be taken as the 1st k digits of the sequence. This code can be genf* 
erated from a k -stage SRG of Figure 23 loading the stages of the generator 
with the k information digits and then letting it shift for p k - 1 shifts. 



Figure 23. Pseudorandom Encoder 

This code can be decoded by choosing the best match* between the received 
sequence and all shifts of a locally generated sequence using an identically con- 
nected SRG, or by a division circuit or by majority decision circuits. The 
optimality of this code will be proved by finding the minimum distance and com- 
paring it to the theoretical upperbound (see Appendix E) for systematic codes. 


Since all non-zero codewords of this code are shifts of a maximal sequence 
the distance vector is also the same maximal sequence shifted by some shift. 


Since a maximal sequence of length p k - 1 contains all possible p k - 1 
non-zero k-tuplets and since each digit has the same frequency except for the 
zero digit that appears one less than any other element, each element must 
appear p 1 *" 1 times in the sequence and the zero element must appear p 1 *” 1 - 1 
times, ' . 


^ ti. • 


This process is digitaLcorrelation. / 
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Applying the notions of Appendix E, the Hamming distance of each distance 
vector (which is also the minimum distance c^) is 


d H = P 1 *' 1 2^ d W (a i> = P k "‘Cp-l) 

i = 1 

but for any systematic code it was proven in Appendix E that dy cannot be 
larger than , 


np*-* (p - 1) ' ' 

P k " I 

letting n = p k - 1 we find that d K cannot be larger than p k “* (p- 1). 

Consequently this code is optimum with respect to the Hamming distance. 
Using a similar argument for the Lee distance for this code 


V p- £ ■ p-‘ - ■> 

i = l 

but from Appendix E for any systematic code 


, „ n p--* (p 2 - 1) 

a, < 

4(P l -l) 

’ 

again letting n - p k - 1 

d L < Ip 11 * 1 (P 2 -1) 

Again we see that the pseudorandom code is also optimum with respect to Lee 
distance. 
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This code will correct all single double triple up to e = — y- errors. 

It should be pointed out that the correlation and majority decision decoding 
are equivalent but use different mathematical notions. 

In the case of correlation we correlate by counting the matches and mis- 
matches of the sequence and a locally generated sequence. The length of the 
maximal sequence is L and in the binary case we count A{= number of matches) 
and D (= number of mismatches). i 

If A > D we decide that the sequence is correct. Since each sequence dis- 

■ „ - - ' L + 1 L + 1 

agrees with all others in 5 — bits it will take a change ih — - — or more 

(L + 1^-' \ 4 

bits L--^- errors) to have 


A > D 


for the wrong sequence. * 

In the case of majority decision each bit (say a 0 ) is given by — 
braic equations. 2 


alge- 


If more than half of these equations contain erroneous bits, it is possible 
that more than half of the equations will give the wrong solution for a 0 . Thus it 


L + 1 


takes at least ^ errors to decode incorrectly. 

\ 

Further Application of Shift Register Generators 


The error correcting encoding and decoding application described in this 
document are simply some of the immediate applications of pseudorandom se 
quences and multiplication and division circuits to coding. 


Some of the important applications of these circuits are their use for en- 
coding and decoding a class of cyclic codes called Bose-Chauduri-Hocquenghem 
codes,* (BCH), and the Recurrent or Convolutional Codes. Due to their special 
importance, the BCH and recurrent codes will be discussed in a separate paper. 


\ 


The Hamming codes are a special case of the B-OH codes. 


Omr^ UCmiL1TY OF THE 
ORIGINAL PAGE is poo B e 
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APPENDIX A 

The Characteristic Equation of the Transpose o f a Matrjx 

It shall be proven here that the matrix A and its .transpose A T have the 
same characteristic equation 

let B = lA-Ml 

where K is a constant and I the identity matrix 

B t = lA-\ll T = A T -XI T = A T -XI 

det 1 A T “ Kl\ = det B t = det B = det |A -k l| 





APPENDIX B 


The Determinant of the Companion Matrix 
Consider the matrix 


X 1 0 0 0 0 ...... . 0 

0 X 1 0 0 0. 0 


0 0 X 1 0 0 .... . . s\0 


B = 


0 0 0 0 0 0 X1 



0 0 0 0 . 
0 0 0 0 . 
h 0 hj hj hj 



. 0 X 1_ 0 
. 0 0 X 1 

^n- 2 1 + /Xt 


to find the determinant of the above matrix expand the determinant in terms of 
minors of the elements of the last row • • 

n- 1 

det B = Ml “„i + (Vi + ^)M„„ 

1 = 1 

for any i the minor is the determinant of the matrix B with the i th column and 
last row deleted is shown below 
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r~ 


i - 1 


'x r 


n ** i 



C » 0 


i ' 


0 l E 


M ni = det C det E = \ i ‘ l (1) = X* 


i-i 


so 


n“ 1 


d6t B ~ J?’ 1 ) 0 "' 1 h.^ 1 X i ~ 1 + (h n . 1 + X) k*" 1 


i “ 1 


n 
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APPENDIX C 


f 

Some Important Concepts of Linear Algebra and some Results of 

Galois Field Theory 


This Appendix is not intended to be a rigorous exposition of Linear Algebra 
but rather a collection of definitions and results that are applicable to the .ma- 
terial of this paper. 

1. Definition: If the difference of two integers a and b is divisible by a 
third integer p then a and b are said to be congruent modulo p or in equation 
form ' • 

a 3 b mod p (P - l) 

In general if 0 £ r < p then for any integer t 

r + tp = r mod p (C-2) 


all numbers c + tp for t = ± 1, ±2, ±3, form a class of residues 

modulo p (C r ). 

2. Addition, subtraction, and multiplication of the C r -’ s present no prob- 
lem but division is equivalent to finding a solution for x in 

• \ 

\ , ! ‘ 

i 

r = sx + tp 

i 

^ | 

letting r = 1, s = 3, and p = 6, there is no solution for x; to insure the 
existence of a solution of x for all s then p must be a prime. 


3. Fermat's Theorem: If an integer a is not dividible by a prime number 
p then a p_1 = 1 (mod p). S 

Corollary = if a and p are defined as above there exists a unique 
solution for ax 5 b (mod p) and it is found by multiplying the left side by 1 and 

1 • ax s aP' 1 b (mod p) 

• x - a p ~ 2 b (mod p. ) 
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4. Groups: A group is an algebraic system with one operation and its 
inverse. The two operations that we are familiar with are addition and multi- 
plications, with inverses subtraction and division resp; however, the operations 
associated with an algebraic system may be other than' the above and they 
will be in general denoted by 0. Thus if the Group A is a set of elements a t , 
a 2 , .... then a i 0 a. = a k implies that element a k results from the opera- 
tion o on the elements a i and a. « The order of the group is the number of 
element in the group. 1 " 

For a set of elements a x> a 2 .... to be a group under the operation G , the 
following four axioms must be satisfied. 

s K 

i. Closure 



I , such that 


There exists a unique inverse a : 1 for each element a. in the group 
such that 


a. O a ' 1 - at 1 O a. - X 

X X l X 


Note; The fact that we were able to commute the identity and the inverse 
does not imply that all other elements in the group can in general 
be commuted unless the group is commutative . 
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5. Definition: An Abelian or commutative group is defined as a set of 
elements that obey the four axioms that define a Group plus the commutative 
law. If the operation is addition the group is additive, 1=0 and a: 1 = - a. . 

T f the operation is multiplication the group is multiplicative, I =? 1 and 

a i = l/ a i * Obviously, since division by zero is undefined axiom 4 holds for 
all non- zero elements in the group and in axiom 3 the identity must be non- zero; 
for example all real numbers form an additive group, and all real numbers 
except zero form a multiplicative group. The group of matrices is not Abelian 
because matrices are not in general commutative. 

6. Rings: A ring R is a set of elements with two operations addition* (+), 

and multiplication* (.), that satisfy , 

a. All addition axioms for an Abelian Group 

b. The closure and Associative Laws for Multiplication 


c. The Distributive Law: if a, b, c e R then - 
a • (b + c) = a * b + a • c 


If the elements of a Ring satisfy the commutative law under multiplication, then 
the Ring becomes a Commutative Ring. , 

7. Fields: A field is a set of elements that satisfy all axioms of a Com- 
mutative Ring and furthermore it has N 

a. A multiplicative identity 

b. A multiplicative inverse for every non-zero element 


Thus a Field is 

a. An Abelian Group under Addition 

b* An Abelian Group under Multiplication 

b. The elements obey the distributive law 

For example the elements 0, 1, 2, ... p - 1 (where p is prime) form a Field. 

£ 

These two operations are not necessarily identical to the ones that we are familiar with. 
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can be comb.npH h ^ elements forms » ^eld of order s if the elements 
divisor not bein. the , ' Subtraction - multiplication and division the 

betog Lbfect o the . . T , Zer ° < neoessaril y the set), these operations 
ferenop „ *i 1 ° f elementar y algebra, and if the resulting sum dif- 
rence. product or quotient is uniquely determined as an element of the 'set. 

of a s T 0 ttion^?= ntS S6t the ^vision are equivalent to the existence 

prirne _ sx mod p discussed in 2 , and necessitates that p be a 


my T r ° r *«•««. »• 


9. Definition: A finite field as defined above is a Galois field. 
Euler's Generalization of Fermat’s Theorem. 

If a is prime to m > 0 . - 


= i m ) 


where $(m) is Euler's function and it 
than m and relatively prime to m . 


is equal to the number of integers less 



\ 
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SUMMARY 


Postulates of Real Numbers R 
' (a, b, c are in R) 


o 

> 

1 1. 

° & 

o 


a> 

> 

*rH 

o 

a 

o 3 


Pi 

3 

o 

O 'aT 

1=5 £ 
d 43 

g 


& S 

S a 

Og 

% 7L 


G 3 


bn 

c 


S n £2 -Sc -ri 

w O a & < -> .< S' « 


bn 

3 


o 

> 

ci 

- 4 -J 

s 

s 

o 

o 


•o 

a 

• H 

tn 


/\ 


X X 


I. Addition postulates: 

(i) a + b in R (Closure) 

(ii) a + b = b+a ^(Commutative) 

(iii) ^^(b''+ c) = (a + b) + c (Associative) x x 

(iv) There exists "O" such that 0 + a=a 

(Identity) x 

(v) There exists b such that a+b = 0 

(Inverse) ' x 


x 

x 

X 


XXX 

xxx 

XXX 
X x x 

X X X 


n. Multiplication postulates: 


\ 


(i) a.b in R (Closure) 

X 

XXX 

(ii) a.b = b.a (Commutative) 


X X 

(iii) a.(b.c) - (a.b).c (Associative) 

X 

xxx 

(iv) There exists "l” such that l.a-a 

(Identity) 

X 

v X 

(v) There exists b such that a.b ~ 1 

(For a^O) 
(Inverse) 

X 

X 


in. Distributative law^ a.(b + c) = a.b + a.c 



59 



The afore mentioned'notions of groups, rings and fields can be extended to 
polynomials with a f ey logical modifications on definitions. 

. a - For example two numbers are relatively prime if they have no common 

isors (except for unity). Two polynomials are relatively prime if they have 
no common factors. 


b. A number P is prime if it cannot be factored to a form 


P ’ Pi ei P 2 e * 


where p. is prime larger then unity and e . >0. 

. Sim ilarly a polynomial is prime (or irreducible) if it cannot be factored 
into a product of prime polynomials. 

c. A set of polynomials can form a group just like a set of any other 
e ements; under addition one adds the coefficients of similar powers. 

d. Given a number p and an irreducible polynomial P (x) a congruence can 

be established mod [p, P (x)j between two polynomials F (x) and f (x) by the 
equation ... 


F(x) - f( x ) mod [p, P(x)} 


which implies that 


F(x) = f( x ) + p . g ( x) + 


if P(x) is of degree n then the degree of f (x) is less than n and its coefficients 
are less than p. 


(The above is equivalent to dividing F(x) by G(x) to obtain f (x) and then 
reducing the coefficients of f(x) mod p). 

All polynomials of degree n - X form a field of p n elements (the number of 
distinct polynomials whose coefficients can assume one of p values, and there 
are n terms i.e. powers of 0, 1, 2, ... n -1). t 
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Then the ordered n-tuplet consisting of the coefficients of the polynomial 
completely characterizes the polynomial and there are p n of these n -tuple ts ; that 
form the field GF(p n ). 

Powers of Elements " / 

We see then that we can treat polynomials as any other elements, so let us 
cite some of the definitions that apply to elements of a group in general* 

a. An element can be raised to a power, the element may be a simple one 
such as a number; thus if we consider the group consisting of the numbers 0,1, 
2, 3, 4 (mod 5) then 

2° - 1, 2 l = 2, 2 2 - 4, 2 3 = 8 = 3, 2 4 = 16 = 1 


On the other hand we could consider a root a of the equation 


x 2 + x + 2 - 0 



It should be noticed that in the last two examples there exists a one-to-one 
correspondence between the powers of an element mod fp, p ( x )j and the powers 
of the roots of the polynomial P (x). 
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Period of an Element 


If a is an element, then the smallest positive integer e (e / 0) such that 
a c = 1 mod p is called the period of the element. 

Example: let a - 4 mod 5 

a 1 - 4 a 2 - 16 - 1 then e ~ 2 

similarly the period of x mod (3, x 2 + 1) (x 2 = 2) is \ 

/ v - 

x 1 - x x 2 = 2 x 3 = 2 x x 4 = 2x 2 = 4 = 1 e = 4 

We also say that a belongs to the exponent e mod p or P(x). 

Primitive Elements 

If the cycle of an element a (mod p) is equal to the total number of non- 
zero elements in the group then the element is primitive. 

Corollary: Since a* - b(i < e) is another element in the group and since 
a* = c e G b / c then the powers of this primitive element a generate all 
the non-zero elements of the group. 

Example: Element 2 of the Group (0, 1, 2, 3, 4) is primitive because its 
powers generate all non-zero elements of the group 

2° = 1 2 1 - 2 2 2 = 4 2 3 = 3 2 4 = 16 = 1 

Element 4 is non-primitive (we could tell because e =2 less than 4 the total 
non-zero elements) 

4 ° = 1, 4 1 = 4 , 4 2 = 16 = 1, 4 3 - 64 = 4, etc. 
then it does not generate elements 2 and 3. ' 
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Similarly the powers of the element x generate all polynomials f (x) of 
degree n - 1 of GF(p n ) modulo 3, x 2 + x + 2. Table 5 shows the coefficients 
b, c of ax 2 + bx + c Mod {3, x 2 + x + 2) and the coefficients d, e 
+ ea + f of the powers of the root a. of the polynomial x 2 + + 


f of 


da 2 


2 . 


Since all 3 2 - 1 = 8 of the non-zero elements of GF(p n ) are spanned (or 
generated) by the powers of x the polynomial is primitive and its period is 
e = p n - 1. 


. Table C-l 

The Powers of x Mod 3, (x 2 + x + 2) 
and the Powers of the Hoot a of x 2 + x + 2 = 0 



b 

c 


e 

f 

Number 

Represented 

x° 

0 

1 

a 0 

0 

1 

r~ 

X 1 

1 

0 

a 1 

1 

0 

- 3 

x 2 

2 

1 

a. 2 

2 

1 

7 

x 3 

2 

2 

a 3 

2 

2 

- 8 

*< 

°\ 

2 


0 . 

. 

: 2 

2 

X 5 

2 

^0 

a s . 

■ 2 

0 

6 

x 6 

1 

2 

a 6 

1 

2 

5 

x 7 

1 

1 

a 7 

1 

1 

. 4 

r-t 

11 

00 

X 

0 

1 

a 8 - 1 

0 

1 



A primitive polynomial is also defined as an irreducible polynomial whose 
roots are primitive. 
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I 

Since usually the problem is to find the polynomial or polynomials belonging 
to the period * e the procedure of finding all irreducible polynomials with period 
e will be outlined. 

First some preliminaries — since 


then 


x e = 1 mod [p, P(x)] 


x e - 1 - 0 mod [p, P i (x)] 


where P^x) are all irreducible polynomials belonging to e. Thus, since 

x* - 1 s 0 implies j 

i 

j 

x e _ i = f(x) P A (x) + 0 for each i 

then each (x) must be a factor of x e - 1; the expression of the product of the 
irreducible factors of x e - 1 is given by the cyclotomic polynomial 



e = 0 P* 1 . Pi prime 


V 


* 


This is equivalent to 


finding polynomials that have period e. 
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f . . ? a r J iatte ^ of f e ( x ) ha s all the primitive roots of period e. If 
of f (x) aS i S N nN UOh ^° rS and U 016 degree ° f each faot0r ls n then the degree 

But it can bp proven* that the degree of f e ( x ) is <t(e) thus: 

Nn = 0(e) 


and 


N = Hi) 


/■ x 


roote! P " " 1 th6n f ' <X) 00ntains aI1 ^reducible polynomials if with primitive 


.Determining Wheth er an Irreducible Polynomial Is Primitive 

. irr ®ducible factors of x* - 1 (e = p» - i) are identical to the ir- ' 
reducible polynomials of all degrees n such that n divides m; then 

1 = P i(*)P 2 (x) .... P N (x) 
if the number of polynomials of degree n is I (n), then 


\ 


' \ 

gw -v 

n/m 


On the Periods of Non-Maximal Sequences 

If e divides p" - l and e does not divide p* - 1 for any i < n then there 
0(e) . 

are n irreducible polynomials of degree n with period e. 

periSr 0U5ly ^ P " “ 1 " PrimeT th6n 6 must of “eoessity be p" - i (maximal 


[l] p. 20 or [ 11 ] p. 138 
^Mersenne prime 
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APPENDIX D 


The Reverse Sequence 

Consider the shift register of Figure D-l. 





where 


x = (h n-1 D + h n _ a L 2 +...,+ hjD"* 1 + h 0 D") X 


0(D) = (I - h n . x D - h n _ 2 D 2 - h Q IP ) 


(D-l) 


(D-2) 




/ \ 




A sequence r reverse to X is obtained by letting the new sequence r be 
the same function of the digits ahead instead of the past digits. This can be 
accomplished by changing D 1 to D -i then the reverse sequence r is 


s A h n-i D “ l + h n-2 D " 2 + • V * + h 0 D-°) 


(D-3) 


multiplying both sides by D n . 


IP r = (h .IP”* 1 t h 0 D"‘‘ 2 + 


h l D + h 0 ) r . 


(D-4) 
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Example consider the SRG of Figure D-3 p = 3. 



a. 


© 


Mod ,3 


Figure D-3 


1 0 
1 1 
2 ? 
0 2 
2 0 
2 2 
1 2 

0 

1 0 


In this register the sequence is x = l l 2 0 2 2 1 0 and h 0 = hj = 1. 

1 hj 

Changing h 0 to = 1 and hj to - — = -l =2 we obtain the circuit of 
Figure D-4. 0 "o 






1 0 

2 1 
2 2 
0 2 
2 0 
1 2 
1 1 

0 

1 0 


Figure D-4 

The sequence of Figure D-4 is 1 2 2 0 2 1 1 0 which is the reverse of x. 

Note: Division £ mod p is accomplished by taking an integer t, 

1 5 t < p - 1, such that — 1 2 3 is integer. 
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APPENDIX E 


0 

1 

1 

2 

0 

2 

2 

J_ 

0 


Optimality of Codes (Hamming and Lee Distanc e) 

There are more than one ways of defining optimum codes; one way is to 

!f " ‘ he “ r and M «« number of words fixed and find a code 

such that no other /n Uv * — *” *■ * 

(or larger e). 


/ 11 V * J ... 

(n, M) code will result in a smaller probability of error 


All e error correcting codes that do not correct any e + l-tuple errors 
are called perfect (close-packed) and the ones that do not correct any of the 

P,,ri;"'LT”Z»». 1,d obv ‘“'» “ ■»"« «■< 


Since e = 


d-1 


2 where d is the minimum distance between any two code- 

words in the code maximizing d is equivalent to maximizing e and consequently 
the performance of a code can be evaluated by means of the parameter 

. ^ next section we sha11 ^e maximum-minimum distance of a <n:oup 
code, however, we must first define what we mean by distance. P 


The cyclic (or Lee) [16] distance is the function 


d = 


n 


i = l 


where 


d. = 

i 


min 


{ a i “ b i* b i - 3i} 


and Wj , w 2 two codewords are defined as 

w i = ( a i a 2 a 3 •••• a n ) . 
w 2 " ( b i b 2 b 3 ■ — b n ) 

*M - p k usually. 
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On the other hand the Hamming distance is defined as the number of places in 
which, two codewords disagree 


n 

■ Z> 

i“ 1 


where 


•»* = 


fl if »i b i] 


0 if = bi j 


In the case of p = 2 or 3 the two above mentioned notions of distance 
become the same. j 

Example: Consider the two words in GF (5) 

(p-6) ; 

\ * • 

1 

Wj — 43212.0 

Wj = 1 2 4 1 3-4 . 


w^-Wi =>-3 — 1 2 0 1 4 - 2 4 2 0 1 4 
— 3 1 "2 0 — 1“4 = 3 1 3 0 4 1 


the Lee distance vector is 2 1 2 0 1 1 and 


d L =2+l+2+l+l = 7 

\ • 

the distance vector is 1 1 1 0 1 1 and the Hamming distance is 


d B = S 


Definition: A systematic code is a code W that consists of codewords 

w c w such that the first k digits are the information digits; the last m digits 

‘ the ch-ck digits and they are Unear combinations of the information digits 
the chwCic aigi y 8BPK0DUCBILITO OF W£ 

O&IGINAL PAGE IS POOP, 


are 
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* ^ + 1 » . *. . j. w k + m 


Theorem: A systematic code is $so a parity check code. 

Theorem: Every parity check code is also a group code and vice-versa. 
/» / * 


Since for any co^q 


e = 


_ d - 1 




Sed I s sssr : *t:izzt^z°zt cx cod “- *>* 

optimum code. d (d - min. distance) is an 


On the Maximum d of a Systematic Code 


\„ 


Consider an array made up of all p k codewords of an /r, u, * 

P-narycode. This arrangement generates an o k v f ( ' k > systematic 
C matrix. generates an p x n array (matrix) called th 

* 

coi™Tc“ E ‘“ wm exactly p — ti„.„ „ cl 

T* “ prove *“> *'* 

“ “ — — » - SS? l P r.S^,T?' 

b ““*" , Jj, dtjlt “““ 




j«i 

information 'cUgit^pp^tr^p^u^ “** 

an equal number of times. 1 0 UkQ ch of tiie P values 
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Example: Let a kt ,= aj + a, mod 3, 
corresponding to all aj , a s combinations 


Table 6 shows the values of 


®k + J 



No "' “sing the closure axiom of a group code , the sum (or difference) of anv 
two words ,s also another codeword and in the case of difference sum of w 

,l * ,L ** - •» 2 


of w. and 
a 


Thus each element of the distance vectors will 


appear np 54 ” 1 times in C. 


equal^s^elSTTf ^ n0Q - Zer ° el “ * <, 


X. W 


F 

npk 1 ^ d w C a i) = np k_1 (0 +1 + 1 + J+ x... 

i “ 1 

In the case of Lee distance 


1) - np k “ l ( p - i) 


/ 

d w = min {a., - a 
thus d w takes on the values shown in Table 7 
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Table E-l 

The Lee Distance Functions 


■ 

0 

1 

2 

3 

1 

P “ 1 
2 

■ 

p + 3 
2 



0 

— a 

i 

0 

p - 1 

p - 2 

p - 3 

■ 

HXI 

p - 1 

p - 3 

B 

B 

0 

wm 

2 

2 

d 

W 

0 

1 

2 

3 

■ 

P - l 
2 

B 

2 


B 

0 


and the total d w is 


d = np k_1 2 1 + 2 + 3 + ... 


-] 


' V 


p is odd 


= np 1 ’ 1 (^) (E^i) f £ pX ' 1 [pX - 1] 


p odd 


Since there is a total of P k - 1 words the maximum d cannot be larger than the 
average distance; thus 


< n P k " 1 (P ~ l ) 


H — 


p k — 1 


(E-D 


and 


< n P k ‘ 1 (P 2 ~ 1 > 


- 


4 (p k - 1) 


(E-2) 
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APPENDIX F 



Let t be the number of stages of the Modular Shift Register of Figure F-la 
with X representing the input sequence and Y the output sequence; if D signifies 
a^el-ajrope r ator and D i a delay of i units, then 

Y = X + h t _j DX + h t . 2 D 2 X + ... + D 6 ' 1 X + h Q D l X (F-l) 



/■ t 

[i + h t . x b + h t _ 2 D 2 + ... hjD 4 " 1 + h 0 D*] X 


if D* is replaced by A _i where A is an advance operator the above equation 
becomes ' • 

Y = A* 4 [h 0 + h l A + h 2 A 2 + ... h^jA*" 1 + A*] X (F-2) 

Since the characteristic equation is 

t-i 

X = - Z> Ai+A * 

i**0 

V 

4 the Equation (F-2) can be rewritten as 

Y = D* [- 0 (A) + 2 A* ] X 

the multiplication of X by A 1 +2 h ; A* is obvious; the D* factor indicates that 
one will need t extra shifts to get the product sequences out of die shift register. 

Referring to Figure F-lb with X and Y as the input and output sequences 
respectively, 

Y = X + h t „ x DX + h t _ 2 D 2 X . . . + Hq D X 


(F-3) 


(F-4) 
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Figure F<Ob. SSRG Multiplier 
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or 


Y = 


D* X 


Similarly referring to Figure F-2b 



0(A) 


(F-6) 


but 


we can develop Equations (F-7) and (F-8) 


Z V X + + h t . a D 2 Z + . . . h 1 D t ” 1 Z + h 0 D‘ 


A*X 


i*0 ' TZT 


- A t X 

„ V 1 0(A > 

A" - ) h. A 1 

t 

i*0 


y 


(F-7) 


thus 


Y = D*Z 


x 


■ \ 


(F-8) 


Y = D‘Z = 


D e A C X 


0(A) 0(A) 


Another dividing circuit with an advance equal to t is shown in Figure F-3. 
The equivalence of Figure F-3 to Figure F-2b is apparent because X re 

“v^ceVfroS C t. bUt Y ^ m ° Ved “ by ‘ S ^ 6S Which — « «■ ^ 

Thus for the circuit of Figure F-3 


Y = X + DYh 


t-l + *V 2 D 2 Y hftD 1 Y 
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Y = 


X 


A*X 


i - JX. pt-- 

i°0 


At - y-'h.A' 

/. I 1 

i 3 0 


A 1 X 

0(A) 


X 


In general the circuit of Figure F-4 gives the following results. 

Y= [Z] + X = [(h 0 D* +h 1 D , “ I + . . . h t _jD) Y + (- g 0 D' - gl D'->-, . , g^fa) X] + X 




h 0 Dt - hjD 1 " 1 «... h t-1 D + I) Y 

“ (“ g 0 Dt ~ g 1 D t “ 1 - 

• • - - Et-jD + I)X 

t-i 

~ Y g: D* _i + I 

/-- ■ J 

-£ gi A‘ + A< . 

\ (A)X 

V - i = 0 

Y = — v = 

i = 0 

t-1 X 

-• T h.Dt- 1 + I 

i = 0 

i “0 

•K C A ) 



Figure F*4 
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